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Abstract 

We develop two new classes of space-time Gaussian process models by specifying co- 
variance functions using what we call a half-spectral representation. The half-spectral 
representation of a covariance function, K, is a special case of standard spectral repre¬ 
sentations. In addition to the introduction of two new model classes, we also develop 
desirable theoretical properties of certain half-spectral forms. In particular, for a half- 
spectral model, K, we determine spatial and temporal mean-square differentiability 
properties of a Gaussian process governed by K, and we determine whether or not 
the spectral density of K meets a regularity condition motivated by a screening effect 
analysis. We fit models we develop in this paper to a wind power dataset, and we show 
our models fit these data better than other separable and non-separable space-time 
models. 

Keywords: Space-Time Processes, Spectral Density, Fourier Transform, Covariance 
Function 


1 Introduction 

Continuous natural phenomena in space or space-time are often modeled statistically as 
Gaussian processes. Generally, a Gaussian process model requires specification of a mean 
structure and a covariance or dependence structure. Since covariance models must be positive 
definite, mathematically valid dependence structures can be quite difficult to define. There¬ 
fore, a primary focus in defining new Gaussian process models is on defining valid covariance 
functions. A covariance function, K, can be defined explicitly or implicitly in a number of 
ways. For example, for continuous K{x), where K{x) = f exp(i^'^x)F(dC with x,^ e 
specifying F or the spectral density, / (assuming it exists), where F{dC = will 

represent and characterize dependence structure in a Gaussian process. In this paper, we 
explore an alternative representation of K we call the half-spectrum. We show half-spectral 
models are easy to define naturally, and we show many half-spectral models have several 
nice modeling properties. 

For a stationary, continuous space-time covariance model K (s, t) with s G and t G M 
with integrable spectral density, g{X,u), where A G and ca G M, we can represent K with 
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g via Fourier transform, 


K{s,t) 


1 

{2ttY+^ 


g{\, uj) exp (is^X + itu) dX du. 


( 1 ) 


A half-spectral representation of K can be obtained by performing one of the two integration 
steps in Q with respect to either A or u. After integrating over either Xot u, K is represented 
by the Fourier transform of an expression relating distance and frequency pairs: (s,a;) or 
(A, t). We therefore call covariance representations of this type either half-spectral models in 
time (if in terms of (s, oj)) or space (if in terms of (A, t)). In this paper, we study half-spectra 
in time of the form f {u)C{s6{oj)) exp{i9{u)(jYs) defined such that 


K{s,t) 


= / f{u)C{sS{u)) exp{i9{uj)4Ys) exTp{itu)du. 


( 2 ) 


Here / is the spectral density of K{0, t), the temporal covariance function at a single spatial 
site; C is any valid correlation function in with a spectral density; and 6 is an even 
positive function that determines the space-time interaction properties of the model. The 
odd, real function, 9{-), and the unit vector, 0 G determine space-time asymmetry in K 
by specifying a phase relationship. By Theorem 1 in Stein (20056), we know K thus defined 
is a valid covariance model. 

Space-time asymmetry can in many cases be thought of in terms of movement of a 
process through time. Gneiting (2002) first introduced the term fully-symmetric to describe 
covariance models that have the following property: K{s,t) = K{—s,t) = K{s,—t) = 
K{—s, —t) for all s G and f G M. For models of physical processes, full-symmetry can 
be a strong assumption; thus, 9 and 0 are important model building tools. For much of 
this paper, we primarily consider the space-time symmetric case with 9{u) = 0; hence, 
we mainly study half-spectra of the form f{u)C{s6{u)). However, as we show in Section 2, 
some important modeling properties of K will hold, independent of 9 or 0. Restriction of our 
analysis to models defined by f {u)C{s6{u)) should therefore not be seen as a simplihcation. 


Cressie & Huang (1999) hrst used half-spectral representations in space to help dehne 


several non-separable, closed-form space-time covariance functions. 

Gneiting ( 

2002 

) used 

half-spectral models as a stepping stone to extend much of the work in 

Gressie & 

iuang 


(1999). Gneiting (2002) also focused on establishing a large and flexible class of closed-form 


covariance functions. Stein (20056) showed half-spectra in time can be fit directly to cer¬ 


tain data structures using a multivariate Whittle likelihood approach. [Kent fc Mosammam 


(Submitted) also focus on the class given in (|^ and produce model fitting and inference 
strategies. Given the general usefulness of half-spectral models, it is natural to push their 
development. We go a step further than these authors by developing several properties of 
certain half-spectral forms. 

The fully-symmetric, half-spectral form we study, f{u)C{s6{u)), is quite flexible and 
lends itself to new interpretations. Purely temporal properties of these models are determined 
by /, and purely spatial properties are determined by the real integral J f {oj)C{sS{u;))du. 
This real integral can also be seen as a mixture of covariance functions with varying ranges 
or simply as an expectation. These models also serve as one fairly direct way to extend 
common purely temporal models to the spatio-temporal domain. The space-time interaction 
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properties of these models are determined by S. When S is constant, temporal and spatial 
marginal covariance functions can be specihed completely independently. In this setting, 
K{s,t) is proportional to a product of its spatial and temporal marginal covariance func¬ 
tions: K{s,t) oc K{s,0)K{0,t). A model with this property is called a separable model, 
and like Cressie & Huang ( |1999 ), Gneiting (2002) and several others, we avoid separable 
models because they have been criticized as unnatural (Kyriakidis & Journel 1999). Fi¬ 


nally, if the spectrum of C is known, the full spectral representations of f{u)C{s6{u)) or 
f{u;)C{s6{oj)) exp{i9{u)(l)'^s) can be determined straightforwardly; thus, full spectral diag¬ 
nostics and considerations can be easily applied to half-spectral models of this type. 

We use the flexibilities of f{u)C{s6{u))) and f{u)C{s6{u)) exp{i9{u))(l)^s) to build new 
classes of models with several desirable modeling properties. [Stein ( |1999[ ) has established 
the tremendous importance of the degree of mean-square differentiability (or smoothness) 
of a process on predictions and assessing uncertainty in these predictions. We therefore 
work to develop models that have flexible degrees of smoothness in space and time. We also 
consider carefully the space-time interaction properties of the models we develop. Again, 
we avoid space-time separability, but we additionally attempt to dehne models that have 
“natural” space-time interaction properties. There is less research on properties of space- 
time interaction in space-time models; hence, “natural” space-time interaction is difficult to 


dehne without a specihc application in mind. However , [Stein ([2011[) provides one condition 

/, [Stein 


that we might want to assume in practice. Specihcally, [Stein[ ( [2011[ ) argues for the following 
condition on the full spectrum, g\ 


lim sup 

||(A,w)||^oo 


g{X + v,u + u) 
g{X,uj) 


= 0 


(3) 


for all hnite R. The limit ||(A,a;)|| —)■ oo indicates any path to inhnity may be taken. In 
particular, either A or a; may be bounded or hxed as the other coordinate goes to inhnity. 
Essentially, the condition in (|^ requires g to hatten out in a relative sense at high values of 
A and/or oj. 

Stein (2011) justihes ([^ by considering interpolation properties of models determined by 


g. Specihcally, Stein (2011) considers asymptotic behavior of best linear unbiased interpo¬ 


lations using points near to and far from an interpolation site. Stein ( 2011[ ) proves that if g 
satishes ([^ and has further mild properties, then as the nearby points approach the interpo¬ 
lation site, interpolation using only the information in the nearby points becomes optimum 
in the sense that adding the information from the far points does not improve predictions. 
This broad concept is called the screening ehect (Chiles & Delhner 1999). The theorems in 


Stein ( 2011| ) are not completely general, but they suggest that a space or space-time model 
with a spectral representation that does not follow the condition in (|^ may have undesir¬ 
able interpolation properties. We therefore use this condition to guide development of our 
classes of half-spectral models. Hence, the models we develop here may have more natural 
interpolation properties and, by extension, more natural space-time interaction. 

As further conhrmation that the condition in ([^ may describe natural models, a number 
of physically derived Gaussian process models will satisfy (|^. For example, models dehned 
using stochastic partial differential equations will often meet (|^ when white noise forcing 
terms lead to processes with integrable spectral densities. In particular, Gaussian process 
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solutions to stochastic versions of convection-diffusion equations will satisfy (|^ ([Lindgren 


et al. 2011). 


Several classical “unnatural” models do not meet the condition in (|^. Separable models 
in particular do not follow ([^. In one or more dimensions, the squared exponential covari¬ 
ance, K{t) = exp(—which produces analytic realizations is also excluded since its spectral 
density, v^exp(—ca^/d), goes to zero too quickly to satisfy The triangular covariance 
function K{t) = (1 — which has documented undesirable interpolation properties is 
excluded as well since its spectral density, 2(1 — cos(a;))/ci;^, oscillates too violently to flatten 
out in the relative sense required by (|^ ( [SteI^[I^ . 

It should also be noted the condition in (j^ is a more general condition than one posed in 


Stein (2002), wherein g is required to be asymptotically proportional to a regularly varying 


function. Like Stein (2011), Stein (2002) uses the screening effect to guide generation of 
restrictions on g. We use ([^ over the condition in Stein (2002) because it describes a more 
general class of functions. Additional screening effect analysis can be found in Stein (2015), 
wherein conditions showing when a screening effect will not hold are given. Stein (2015) also 
supports use of models satisfying exactly the condition in (|^. 

Beyond half-spectral methods, there are a host of other techniques that can be used 
to produce valid non-separable space-time and other multidimensional covariance models. 


Brown et al. (2000) present a convolution based method to produce a flexible anisotropic 


into a nonseparable model. 

Kolovos et al. 

(2004) 

provide an overview of many methods 

including full spectral methods and methods requiring solution of stochastic partial diher- 

ential equations. Furthermore, 

Kolovos et al. 

(2004 

) present a technique to produce models 


valid in many dimensions from one-dimensional models via weighted sums. 

Genton 

2007) 

approximates non-separable models using separable covariances. 

Fuentes et al. 

(200^ 

n and 


Stein (2005 a) use full spectral representations to dehne non-separable models. 


In this paper, we advance the half-spectral covariance model representation in (|^ and 
show that only specihc forms of functions C, /, 6 and 6 will lead to models satisfying the 
condition in ([^. In the next section of this paper, we show space-time models will satisfy 
(|^ independent of the specihcation of 9 as long as 9 is locally bounded. This conclusion 
allows our remaining analysis in this section to focus on fully-symmetric models. We develop 
two restrictions on the set of functions, C, / and S and prove that models violating these 
restrictions will not meet (|^. These restrictions are subsequently used in Section 3 to guide 
development of two new classes of half-spectral models. One class of models satishes both 
restrictions presented in Section 2. The second class satishes only one of the restrictions 
in Section 2. For both classes, we show how smoothness for a fully symmetric model in 
space and time may be changed by specihcation of components of C, / and 6. In Section 4, 
we ht examples from both classes of models to daily average wind speed data recorded at 
diherent spatial locations across Ireland. We compare hts of these models to other models of 
similar form. We hnd models in the classes we develop to be easily adaptable to the data we 
consider, and we show they better capture space-time interaction in the Irish wind dataset 
compared to other separable and other non-separable models. 
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2 Restrictions on half-spectral forms 

The half-spectral form in ([^ in general does not meet the condition in ([^. Let h be the 
spectral density of the spatial covariance function C. The full spectral representation of K 

is 

K{s,t) = [ [ f{u)5{uj)~‘^h( - ^ exp{is^X + itoj)dX du. (4) 

JmJRd- V J 

Let g{X,uj) be the fully-symmetric spectrum, g{\,uj) = f{oj)5{u)~^h{X/5{u))-^ therefore, 
we can write the general spectrum of K as g{X — 6*(a;)0,a;). To show when g{X,oj) or 
g{X — 6{uj)(j),u) satisfy (|^, we hrst establish the result in Theorem 1 that states: g{X,u) 
satishes @ if and only if g{X — 6{oj)(f)^oj) satishes ([^ as long as a mild regularity condition 
requiring 6{(jj) to be locally bounded is satished. This result permits the theoretical focus of 
this section to center on fully-symmetric models without much reducing the generality of our 
results. With Theorem 1 established, the remaining theory in this section gives necessary 
conditions and restrictions on a fully-symmetric model (dehned only by /, C and 5) that 
must be met in order for g to satisfy ([^. Proofs of Theorem 1 and the Restrictions presented 
in this section are in the Appendix. 

Theorem 1 Let g{X,u}) be the full spectrum of a space-time covariance function where X is 
the spatial wavenumber and oj is the temporal frequency. Let 9{-) be an odd function, and let 
(p be a unit vector in The following two statements hold: 

(i) Let 9(-) be locally bounded. The full spectrum g{X,uj) satisfies ^ if and only if 
g{X — satisfies 

(a) Let g{X,uj) be strictly positive and let g{X,uj) satisfy If g{X — 6*(a;)0,a;) satisfies 
(^, then 9{uj) must be locally bounded. 


Remark Statement (i) is bolstered in a practical sense by statement (ii). Model building 
strategies often start with a fully-symmetric model that may be tweaked to be not fully 
symmetric. If we accept (|^ as a desirable condition, both the fully-symmetric and the not 
fully-symmetric versions of a model should satisfy (§. Statement (ii) therefore establishes 
that the regularity condition in statement (i) (the local boundedness of 9{pj)) is a natural 
condition. 

With Theorem 1 in mind, we focus on fully-symmetric half-spectra f{u)C{s6{u)) with 
full spectra g{X,u). For g{X,u) to meet the condition in ([^, we show the spectrum h 
and function 6 must lead to a factorizable form: h{X/6{u)) = H{X, u)6{uY/ f (u), where H 
satisfies ([^. Though h and 6 of this form can be seen to trivially meet ([^, the restrictions 
developed in the following paragraphs establish certain more flexible forms will not satisfy 
(§. 

Since g(X, u) = f(uj)6(u) ‘^h {X/5{u:)), we can more simply write g in terms of a marginal 
function in uj and a joint function in A and u. Let g{X,oj) = p{u)q{X,u). The following 
restrictions establish necessary conditions on p and q that must be met in order for g to 
satisfy the condition in ([^. 
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Restriction 1 Let the spectral representation of covariance function K have the form g{X,u}) 
p{u)q{X,u). The following two statements hold for spectral densities with this parameteriza¬ 
tion. 

(i) If g and q satisfy the condition in then p must he constant in u. 

(a) If g satisfies the condition in iB, then for every point uq such that p{uJo) is finite and 
positive, the marginal spectrum gl,^{X) = g{X,u:Q) must meet the condition in (^. 


Remark The requirement in (i) that q follows the condition in (|^ may be weakened. Our 
proof for (i) needs only that hmg(A,Ci;o + 7^ 1/C) a fact which follows from q 

satisfying ([^. This condition however seems quite arbitrary, and we have opted to use the 
stricter condition. 


The implication of Restriction [T] is simply that the space-time interaction function 6 
cannot be determined completely independently of C and / if we wish to use models that 
follow the c ondition in ([^. Of note is the fact that this restriction applies to several models 
proposed in |Cressie fc l^ang (1999), Gneiting (2002) and Stein| (20056). 

One may dehne the spatial interaction function as (5(a;) = /(a;)^C to escape the conditions 
of Restriction!^ however, 5(a;) defined in this way decreases to zero for increasingly large ui 
since / must be integrable. This behavior of S contradicts intuition—for example, considering 
(|^, we see ^( 0 ;) —?■ 0 implies coherences between multiple time series are highest at high 
frequencies. More formally, 6 decreasing to zero or having a finite limit as u approaches 
inhnity will not generally lead to models satisfying the condition in ([^. 


Restriction 2 Let g{X,u) = p{u)q{X/6{u)), where p{u) is positive and finite for all suf¬ 
ficiently large |a;|, q is a non-negative, continuous, integrable function that is not identi¬ 
cally zero, and 5{u) is even with a well-defined limit as |a;| —>- 00 . If g satisfies then 
limi^l^oo 5(a;) = 00 . 


Remark A version of this Restriction exists concerning (5(a;) without a well-dehned limit as 
|a;| —)■ 00 . If liminf|^|_,.oo is hnite, then under the additional condition that q satisfies 
(|^ it can be proved that g cannot satisfy (|^. We let q be more general and include the 
stronger condition on 6 in this Restriction to match the class of models we develop in Section 

3.2. 


Restrictions and confine the form of 6. Implicitly, the form of h is also restricted. 
For half-spectral models satisfying ([^, if S must increase to infinity, f{uj)S{u})~'^ cannot 
be constant, implying h{X/6{u)) itself cannot satisfy (|^. On the other hand, for hxed u, 
h{X/6{u)) must satisfy (|^ in A by part (ii) of Restriction!^ One way forward is to choose h 
and 5 such that h{X/6{u)) admits the representation, h{X/6{u)) = II{X, u)6{u)Y/f{u), where 
H satishes (!^. A half-spectral model thus specihed will satisfy (!^. Finally, by Theorem 
1, with any locally bounded 6, h((A — 6*(a;)0)/(5(a;)) specihed in this way will also lead to 
models satisfying (!^. 
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3 New classes of models 


We build two new classes of fully-symmetric models; thus 9{u;) = 0 for each of the classes 
of models we present in this section. If 0{uj) is non-zero, models with space-time asymmetry 
can be dehned. Importantly, as we showed in Section 2, a zero or non-zero 0{u}) does not 
affect whether or not a given model will satisfy ([^ as long as 6* is a locally bounded function. 


3.1 A class of models satisfying the natural condition 


Let h{X) = A|p) ('^+'^/2+i/2)^ Matern spectral density with smoothness u+1/2 > 0, 

a > 0 an inverse range parameter and 0 > 0, a variance parameter. For a given /, to ensure 

_ -I /Q 1 

are not violated, choose d(cj) = /(cn) ' ‘'+ 1 / 2 . Plugging into the space- 

, a new set of spectral densities can be written 


Restrictions and 
time spectrum in (|4 


9(A, (ay + p||2) -(''+(^+W2) 


(5) 


If /, itself a spectral density, satishes / ~ CfCJ~^ for some k > 1 and Cf a positive constant 
depending on /, then (|^ describes a class of models that satishes (|^. We write covariance 
functions with this half-spectrum Kf to indicate the temporal spectrum / determines a 
specihc model in this class. 

We use a Matern spectral density in space to form this class of models for three reasons. 
First, it is a natural model to analyze since spatial modeling is often carried out using 
a Matern covariance or a modihcation of a Matern covariance. Second, its form leads to 
easy comparison with the conditions of Restrictions and Third, the Matern spectrum 
gives ([^ some desirable Matern-like properties. For example, as we show in the following 
paragraphs, the parameter u, is directly related to the spatial smoothness of the resulting 
Gaussian process. The 1/2 added to z/ ensures this formulation extends the space-time 
Matern covariance naturally. If /(ca) is a one-dimensional Matern spectral density with 
smoothness u, then Kf{s,t) is simply a d -|- 1 dimensional Matern covariance function with 
smoothness u. Note, in this case, u > 0, since / must be integrable. 

The half-spectral representation of ([^ is given simply by plugging the Matern covariance 
into the relevant portion of (|^. 


f{oj)C{s6{oj)) = f{oj 


TT 


rf/20 


X 


2^-i/2r(i/+ (d + l)/2)a2'^+i 


( 6 ) 


et al. 


where /Cj^+i /2 is the modihed Bessel function of the second kind with argument z/-1-1/2 (Olver 
2010). If we Iet_d) absorb terms not depending on a; in (|^ and write Ali.+i/ 2 (s) = 
^ can be simplihed to 


f{uj)C{s5{u)) = (j)f{uj)Mu+i /2 (a||s||/(i:u) 


(7) 


Beyond satisfying the condition in (|^, mean-square differentiable properties of this class 
of models are readily found. For a space-time process, Z{s, t), governed by stationary covari¬ 
ance K{s,t), Z{s,t) is m times mean-square differentiable in time if and only if ^/iF(0,0) 
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exists (Stein 2005a). Following (Stein & Weiss 1971, p. 5), k-th derivatives of iF(0,0) in 


the temporal direction are known to exist if the purely temporal spectral density, /(cj), is 
integrable and J < oo. Hence, if / integrable and / ~ Cf\u\~^ as u approaches 

inhnity, then Z{s,t) will be m times mean-square differentiable in time if {k — l)/2 > m. 
Similar statements hold regarding the mean-square differentiability of Z{s,t) in space. To 
determine spatial mean-square differentiability, we mirror the argument in ( [Stein 2005a 
p. 313), showing Z{s,t) will be m time mean-square differentiable in space if and only if 
{i> + 1/2) ■ {k — l)/k > m. Therefore, with these models, smoothnesses in space and time can 
be dehned via u and the limiting behavior of / determined by k. We call {u + 1/2) ■ {k — l)/k 
and {k — l)/2 the effective smoothnesses of the purely spatial and purely temporal processes 
respectively. Since u > —1/2 and k > 1, arbitrary effective smoothnesses in space and time 
can be specihed using models in this class. 

Example 1 (Matern in Time) 

Let f{ui) = (/9^ + a one dimensional Matern spectral density. To avoid 

overparameterization, the scale parameter is hxed at one. Plugging / into ([^ and ([^, we 
get the spectral and half-spectral forms. 

g{X,uj) = (/(a2(/52+a;2)(-+VWF+V2) + ^2^-(-+('^+b^^^ 


f{uj)C{s6{u)) = (j) {(3'^ + 


2 ^-++ 1 / 2 ) 


(tt||s||(/? + ca ) 


2+/2 


S+1/2N 

.+ 1/2 J _ 


( 8 ) 


Here k = 2 k + 1; hence this process is — 1] times mean-square differentiable in space 

and [k —1] times mean-square differentiable in time, where [■] is the ceiling function. Again, 
it is readily checked that li k = u, Kf reduces to a d -|- 1 dimensional Matern model with 
perhaps different range parameters in time and space, depending on (3 and a. A numerically 
calculated contour plot for u = 1/8, k = 2 is in Figure [^a). Marginal plots of Kf{0,s) and 
Kf{t,0) are in Figure [I|(b). 

Of note in Figure I^a) is the fact that a “dimple”-type property is present in this model 
(Kent et ah 2011). Though the dimple we see in Figurej^a) may not strictly follow the dimple 
dehnition given in Kent et ah (2011), the general phenomenon—that a dimple is indicative 


of higher covariances existing at non-zero spatial lags when the temporal lag is nonzero—is 
clearly present in this model. A broader dehnition of a dimple may be the following: a 
dimple exists if a contour of a covariance function is a non-convex shape. Empirically, this 
appears to be caused by the large difference in k and u and v < k. For k and v closer 
together or u > k, numerical experiments suggest this dimple either disappears or gets 
pushed further from the origin. Since half-spectral forms in space can be dehned similar to 
models without apparent dimples with hexible smoothnesses in space and time can be 


dehned. Note, this model is a special case of a class of models considered by Stein (2005a), 


but the half-spectral form of this model is not given in Stein (2005 a) nor is the connection 
of this model to Matern models mentioned therein. 

Example 2 (Continuous AR(2) in Time) 

From ( Priestle;^|1983 , p. 239), a continuous analog of an auto-regressive process of order 
2 can be dehned by the following two parameter spectrum. 


/(w) = - 

TT 


I3iI32 
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Figure 1: Contour and marginal covariance plots for the Matern in Time model in Example 
1. Effective smoothness in space is 0.5. Effective smoothness in time is 2. 


For large u, f{oj) ~ CfUJ~^] hence this process is one time mean-square differentiable in time. 
Contour and marginal plots are in Figure]^ 

The oscillatory behavior of an AR(2) process is documented in Figure [^a) and (b) by 
the negative covariances. There is a hint of a dimple in Figure |^a), though the effect does 
not appear to be severe. Like the Matern in Time model in Example 1, the dimple effect 
becomes more pronounced when smoothness in space is much lower than smoothness in time, 
and it either disappears or becomes unnoticeable when smoothness in space is much larger 
than smoothness in time. 


3.2 A class of half-spectral models satisfying Restriction 2 

Restriction 2 effectively shows that a model of the form ([^ must satisfy 5(a;) —>■ oo as 
a; —)■ oo in order for ([^ to hold. Of course, models may satisfy 6{u) oo as u ^ oo 

without satisfying (|^. We consider 5— )-cxDasa;— )-ooa condition of interest in its own 
right. In particular, it forces coherences between time series at distinct spatial sites to tend 
to 0 as a; —)■ cxD. In this Section, we define a class of models satisfying 6{u) oo as u ^ oo 
but not ([^. 

Briefly, if / is a probability density (letting C be more generally a covariance function), 
we may write 

R(s,0) =Eo[C(s5(0))] (9) 

where O is distributed according to /. Hence, iF(s,0) depends only on the distribution of 
5(12). Note further that since K{0,t) is determined completely by /, K{0,t) depends solely 
on the distribution of H. Since / is even, H must be a symmetric random variable, and since 
6(cj) is even and positive, 5(12) is distributed as the absolute value of a symmetric random 
variable. Let A and B be continuous, symmetric random variables. We can specify 12 ~ R 
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Figure 2: Contour and marginal covariance plots for the AR(2) in Time model in Example 
2. Effective smoothnesses in space and time are each 3/2. Auto-regressive parameters 

A = /^2 = 1 - 


and 6{fl) ~ |A|; thus, 5(a;) = \F^^{Fb{u}))\ for F^ and Fb distribution functions. Therefore, 
in principle, iC(s,0) and K{0,t) can be dehned independently without using constant 6. 
Moreover, S of this form increases unboundedly; hence this set of models does not violate 
Restriction 2. 


Similar to a class of models defined in Ma (2003), we further define this class by letting 
C(s) = exp(—||s|p). With this C, the spatial model in (|^ is a class of functions studied i 


m 


Schoenberg (1938). If we allow |A| to follow an arbitrary positive probability distribution on 
Schoenberg (1938) proved spatial models in ([^ with C squared exponential characterize 


all covariance functions that are valid in all dimensions. In other words, the class of models 
0 can marginally produce is quite vast. Nonetheless, C as squared exponential has a 
spectrum proportional to exp(—1| A|p/4); therefore, by Restriction (ii), these models will 
not meet the condition in (|^. 

Example 3 (Marginal Matern) 

Let f = Ib = ^ith K, ^ >0. Let C(s) = (j)exp{-a^sf), 

and let A be defined symmetrically by |A| where v, (f), a > 0. It can be shown 

via results in (Bateman 1954, p. 146) that iF(s,0) = (p /Since is a 


Matern spectral density, iF(0,t) = 0/(2^ W(k))A1k(/ 9^)- In Figurewe give marginal and 
contour plots comparable to those in Figure 15 Figure 15) a) shows the dimple in this model 
is much more pronounced than that in Example 1. Empirically, the dimple becomes less 
pronounced when the smoothnesses of the purely spatial and purely temporal processes are 
closer together, but the dimple does not disappear even when v = k. Explicit expressions 
for the half-spectrum of this model are given in the Appendix. 
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Temporal Correlation 
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Figure 3: Contour and marginal covariance plots for the Marginal Matern model. Effective 
smoothness in space is 1/2. Effective smoothness in time is 2. 


4 Application 

We apply examples from the two classes of models presented in Section 3 to the Irish wind 


dataset hrst analyzed by Haslett & Raftery (1989). We compare hts from models in either 


class to similarly parameterized separable and non-separable models. In making these com¬ 
parisons, we focus on space-time interaction properties of the models we £t; hence, when 
possible, marginal spatial and temporal covariances and smoothnesses are fixed at common 
values across the models we £t. We focus on space-time interaction to show the models we 
develop may be natural hrst choices to consider when analyzing space-time data. 

The Irish wind dataset is a record of daily average wind speeds collected at 12 sites in 
Ireland from 1961 to 1978. This dataset has been analyzed several times previously by [Haslett 
& Rafteryj (|1989|), [Gneitingj (|2002|), jde Luna & Gentonj (|2005|) and jSteinj ([2005 6) among 


others. Like these authors, we deseasonalize the data by regressing wind-speed on a few 
(four) annual harmonics, and we discard data from the Rosslare site due to nonstationarities. 
We also take square-roots to obtain more marginally Gaussian data, and we subtract station 
means of these deseasonalized and transformed data. Finally, we divide each station’s time 
series by its respective sample standard deviation. The resulting dataset contains 6,574 x 11 = 
72,314 observations with none missing. 

There are subtleties in these data. Most notably these data have been documented as 
having longer memory in time than covariance models with exponential tails can produce 
( Haslett fc Raftei3^|1989 ). Therefore, to make best comparisons within groups of models, we 
separate comparisons based on the temporal tail behavior (exponential tails versus algebraic 
tails) of the covariance models we consider. 


The wind process also has properties that are not fully-symmetric (Gneiting 2002). The 


primary model comparisons we make in this section involve fully-symmetric models because 
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these provide the best comparisons to established models. However, at the end of the appli¬ 
cation we £t a model that does not exhibit full-symmetry by using a simple model for the 
phase shift present in ([^. 


4.1 Regular monitoring data and model fitting 


Let Z(s, t) be the daily average wind speed at a spatial location s in Ireland observed on day 
t. For these observations, we dehne models in 4-dimensional Euclidean space, (s, f) G x M, 
that we restrict to the actual domain, the sphere x time. Since Z{s,t) is observed at each 
spatial site, Sj, for each time point, j, we can write observational points in the form (sj,j) 
for alH G {1,..., 11} and j G {1,..., 6574}. Data of this form is called regular monitoring 


data (Stein 20056). 


Fitting the models developed in Section 3 to regular monitoring data can be done by 
either computing covariances via a numerical evaluation of the integral in (|^ or by viewing 
regular monitoring data as a multivariate time-series and using spectral methods. We focus 
on spectral htting in this paper; however, to quickly evaluate the integral in ([^ at multiple 
spatial lags for a hxed temporal lag, discrete Fourier transforms can be used to speed com¬ 
putations. We primarily use spectral htting for convenience. It should also be noted that 


C(s(5(c(;)) can be seen as the cross-spectra of spatially situated multivariate time series (Stein 


20056). 


Spectral htting requires maximization of a multivariate Whittle likelihood. The models in 
Section 3 are dehned in continuous space and time; hence, if we wish to use the multivariate 
Whittle likelihood, which estimates the spectrum of a discretely observed time series, we 
will need to account for aliasing. We use a simple aliasing correction. For the continuous 
model f{u)C{sS{u)), we approximate a hnite version of this function with + 

2j'7i)C{s6{u + 2jn)) for —vr < u < tt. Note this sum is a truncation of the proper correction 
in which the sum goes from —oo to oo. We pick the truncation parameter m = 50 for 
convenience. For the models we ht, increasing m beyond 50 appeared to have little ehect on 
likelihoods and parameter estimates; however, in general, tail behavior of spectrums can vary 
tremendously; hence, this truncation should be determined carefully in specihc applications. 


4.2 Results 

4.2.1 Models with Exponentially Decaying Temporal Tails 


We ht the models in Examples 1 and 3 to these data. For comparison, we ht a Matern model 
as well as a separable model with exponential marginal covariances. We also ht a model in 
Cressie & Huang (1999) that was found to best ht a diherent dataset of wind speeds. Since 


the best-htting model in Cressie & Huang (1999) is separable with squared exponential 


covariance in space and exponential covariance in time, the half-spectral form of this model 
str£ 

exp( 


is straightforward to obtain. For the Cressie & Huang (1999) model, /(a;)C(s6(u;)) = 0(/3^-t- 


U} 




Note 5 is constant in this model due to its separability. Cressie & 


Huang (1999) ht their models using a weighted least squares method to match the model 
variogram to the empirical variogram. In the model variogram they include a term related 
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Table 1: Comparison of log-likelihoods of short memory in time models htted to the Irish 
wind dataset. _ 


Whittle Log-Likelihoods of Models with Exponential Temporal Tails 



Log-Likelihood 

Dih. From Ex. 1 

^ Param. Fit 

Example 1 {k = 1/2) 

20,318 

0 

5 

Matern (Example 1, k 

= u = 1/2) 20,199 

119 

4 

Example 3 {k = 1/2) 

19,441 

877 

5 

Separable Exponential 

18,703 

1,615 

4 

|Cressie & Huangj (jl999 

) 18,378 

1,940 

4 


to ||s||. Since we subtract site means prior to analysis of the Irish wind data, we do not need 
to use an analog of this term in our models. 

The only modihcation we make to all four exponential temporal tail models is to add a 
spatial nugget similar to Gneiting (2002) and Stein (20056). The half-spectral representations 


of our models therefore take the general form 


/(w) [C(si(w)) + 


( 10 ) 


where Ip} is an indicator function and jf > 0. 

For models with flexibility in determining smoothness in time (Examples 1 and 2 and the 
Matern models), temporal smoothness parameters, k, were hxed at 1/2 to allow for better 
comparison of all models. Note for the Matern model, this also hxes the spatial smoothness. 
To evaluate the assumption that k = 1/2, we ht a univariate Matern model to a subset of the 
time series at each station, and we found k = 1/2 to be a reasonable estimate of temporal 
smoothness. 

A comparison of the multivariate Whittle likelihoods is in Table Here, the model from 
Example 1 is shown to provide the best ht for these data. That Example 1 outperforms a 
Matern model is expected since Example 1 extends the Matern class. The added flexibility 
in specifying the spatial smoothness appears to add a small amount to the log-likelihood in 
this case. With Example 1, the effective smoothness in space is estimated to be 0.4; hence 
a modest improvement in log-likelihood is not surprising. For processes estimated to have 
drastically different smoothnesses in space and time, we may expect a larger improvement 
in using Example 1 over a Matern model. 

A look at the remaining hts shows smoothness and space-time interaction matter in terms 
of model htting. For example, the Matern model compared to the separable exponential 
model shows an increase in 1,496 of the log-likelihood. Both models have the same number 
of htted parameters and the same smoothnesses in space and time; yet, the Matern appears 
able to capture the space-time interaction of the Irish wind process better. Comparing the 


separable exponential to the model in Cressie & Huang (1999), we see modeling variations 
in space as analytic is perhaps unreasonable. Comparing Example 3 to Example 1, we also 
see simply being able to ht marginal covariances may not directly lead to good models. 
Nonetheless, Example 3 appears to capture space-time interaction in these data better than 
the separable models present in Table [Tj 
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Table 2: Comparison of log-likelihoods of longer memory models fitted to the Irish wind 
dataset._ 


Whittle Log-Likelihoods of Models with Algebraic Temporal Tails 

Log-Likelihood 

Diherence From Kf^ ^ Parameters Fit 

Kf^ (z/ = 1/2) 21,655 

0 4 

G (7 = 0, K = 1) 21,245 

410 4 


4.2.2 Models with Algebraic Temporal Tails 


Gneiting (2002) uses the following covariance model, denoted by G, to analyze these data: 


G{s,t) = (j){j3\t\‘^ + 1) exp 


as 


+ 1)G2 


+V (/^i^r +1) i{s=o} 


( 11 ) 


where /? > 0, k G [0, 2] and 7 G [0,1]. The last term in ( |II| is the spatial nugget as also seen 
in (10). The temporal marginal covariance G{0,t) has algebraic tail behavior. When k < 1, 
G is a classical long memory model in time. In the case where k > 1, G(s, t) is not formally 
long memory in time since G(0,f) will be integrable; however, the algebraic decay in G(0,f) 
for large t is much slower than the exponential decay present in the models in Table [T] and 
hts the Irish wind data better than exponentially decaying models in Section 4.2.1. 

To ht G using a multivariate Whittle likelihood method, the half-spectrum of G is needed, 
but we do not know of a general closed form half-spectral representation of G currently. 
However, specihc separable half-spectral forms of G can be found. For 7 = 0, G is separable 
and exponential in space. For k = 1, a closed form for the spectral density of G(0, t) is readily 
calculated (see Appendix); hence, the half-spectrum of a separable G that is long-memory 


in time can be specihed as long as k = 1 and 7 = 0 are hxed. Note that Gneiting (2002) 


estimated k = 1.544. If we instead let k = 2, a closed form spectrum for G(0,f) can also be 
found, but it is exponential and thus G(0,f) for this model will not meet the condition in 
(|^. With K = 1, G(0,f) meets the condition in ([^ since the spectrum of G(0,f) denoted fc 
decays proportional to (details in the Appendix). 

Since fc decays asymptotically proportional to we can plug fc into the class in ([^ 
to obtain Kf^, a model that satishes the condition in (|^. Fitting both Kf^ with a spatial 
nugget and G with k = 1 and 7 = 0 by their respective half-spectra, we obtain the results in 
Table We £x 1 / = 1/2 for to achieve the same smoothness in space for Kf^ as exists 
for G with 7 = 0 and k = 1. 

Table shows again that compared to similar non-separable models, a separable model 
will not adequately ht these data. This exercise shows further that the class of models 
presented in Section 3.1 is quite hexible and can be adapted straightforwardly to many 
different scenarios. Comparing the log-likelihoods of the short memory models in Table 
to the longer memory models in Table we hnd that G with 7 = 0, a separable model, 
to better ht these data than the non-separable models in Table [Tj The diherence between 
G in Table and Example 1 from Table [T] is 927 Whittle log-likelihood units. This is 
not completely surprising given that long memory properties of these data are apparent in 


looking at marginal correlation plots (Haslett & Raftery 1989) 
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Table 3: Comparison of log-likelihoods of longer memory models fitted to the Irish wind 
datas et. In contrast to Table (j is a non-separable model. _ 


Space-Time Log-Likelihoods of Models with Algebraic Temporal Tails 

Log-Likelihood 

Difference From Parameters Fit 

Kf^ {v = 1/2) 21,471 

G = 1) 21,327 

0 4 

144 5 


As a hnal comparison, we ht Kf^ and a non-separable version of G by maximizing space- 
time likelihoods (as opposed to the frequency domain Whittle likelihoods). The size of this 
dataset (72,314 observations) is quite difficult for space-time likelihood htting of these models 
without making use of computational shortcuts. Specihcally, for these data, calculating a 
log-determinant and a solve involving a 72,314 x 72,314 covariance matrix is required to 
compute the space-time likelihood under the multivariate Gaussian assumption; however, 
even storing a matrix of this size in RAM will not be possible on most machines as it 
requires over 40GB of memory using standard precisions. To perform this calculation, we 
make use of the regular monitoring structure of these data and the temporal stationarity 
of these models. Sorting the data hrst by time and second by location leads to a Block- 
Toeplitz covariance matrix with blocks of size 11 x 11. Using a Block-Toeplitz Levinson-type 
algorithm, one can compute the log-determinant and solve terms simultaneously with greatly 
reduced computational burden (Akaike 1973). 

The covariance model G is given in its space-time representation in ( [II] ). The space-time 
covariance function Kf^ must be computed numerically from the half-spectrum specihed by 
We approximate the covariance function Kf^ via a hnite approximation of the integral 
in (j^. As mentioned in Section 4.1, an approximation of the integral in (j^ for many different 
time lags, t, can be computed quickly using the fast Fourier transform. 

To ensure G and are most comparable, we hx z/ = 1/2 for Kf^ and k = 1 for G. 
With these parameter values, both models have the same smoothnesses in space and (up 
to range and scale parameters) identical marginal temporal covariance models. For G, the 
separability parameter 7 is estimated from the data. Results from htting these models are 
in Table [H 

Model Kf^ hts the data better than G while simultaneously requiring fewer estimated 
parameters. The separability parameter 7 is estimated to be 0.5; hence G is non-separable. 
The marginal spatial and marginal temporal covariances in both models are quite similar; 
thus the slight edge Kf^ appears to have over G in this case may be due to the ability of 
Kf^ to better capture space-time interactions in these data. Gomparing Table to Table 
we see a difference in likelihoods for Kj^. Due to the approximations made in calculating 
both Whittle-type and space-time likelihoods, some discrepancy is expected. 


4.2.3 A Space-time Asymmetric Model 

Starting with A"/q, we generate a space-time asymmetric model, Kf^, by picking 9{u)(j) to 
be non-zero. We use a simple linear translation model for the phase shift, giving 6{u) = pu, 
where p G M. The spatial direction of this shift is determined by 0. Since 0{oj) is locally 
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bounded, Kf^ will satisfy (|^. Gneiting (2002) remarks on the east-west asymmetry in these 
data; hence, for simplicity, we £x 0 G to be a unit vector pointing in a direction consistent 
with an east-to-west direction over Ireland. In principle, (j) can be estimated from the data. 
Lastly, for best comparison to Kf^ in Table u is again hxed at 1/2 for Kf^- 

Using Whittle likelihood htting, Kf^ has a log-likelihood of 21,922. Comparing to Kf^ in 
Table we see a marked advantage to taking into account space-time asymmetry with these 
data. The increase in Whittle log-likelihood is 267 units. The value p was estima ted to be 
positive; hence, Kf^ is consistent with the simple measures of asymmetry used in 
(| 200 ^. 


Gneiting 


Lastly, it is important to note that in the context of modeling a process on the entire globe, 
this phase shift model will not be entirely sensible. The vector pu(() indicates a linear phase 
shift through 3-dimensional Euclidean space. Our data are on the globe however; therefore, 
an east-west phase shift is not everywhere accurately described by the single vector 0. For 
example, while 0 is an east-to-west vector over Ireland, it is a west-to-east vector on the 
opposite side of the globe (for example, in Japan). A better way to model phase shifts on 


the globe in the context of half-spectral models is given in Stein (20056), wherein phase 
shifts are akin to rotations of the globe. In this type of phase shift model, phases depend on 
differences in longitude and/or latitude and not a lag vector in Unfortunately, rotation 
based phase models do not fit exactly within the theory presented in Section 2. Therefore, 
we have opted to use the locally accurate phase shift described by pucf). Since Ireland covers 
only a small range of longitudes, using this simplihcation should not affect results in any 
substantial way. 


5 Discussion 


We developed two new classes of continuous space-time dependency models via half-spectra 
dehned by the form f{u)C{s6{u))) exp{i9{u;)(j)). Both classes of models allow for substantial 
flexibility in modeling the marginal processes dehned by K{s,0) and K{0,t). Moreover, 
both classes of models are non-separable. These models are further theoretically validated by 
meeting at least one of two restrictions we developed in Section 2 to guide our model building. 
These restrictions were developed through consideration of a natural condition posed in [Stem 
(2011). Our model building focused on fully-symmetric models defined by f{u)C{s6{u)); 


however. Theorem 1 in Section 2 established that inducing space-time asymmetry in these 
models using a non-zero 9{u) can be done naturally and easily. 

We compared fully-symmetric examples from the new classes of models in this paper to 


separable models and to a non-separable model developed in Gneiting (2002) by htting these 


models to the Irish wind dataset in Section 4. Models from the class of half-spectra dehned 
in ([^ were shown to ht the Irish wind data better than all other models we examine in this 
paper in terms of likelihood. Haslett & Raftery (1989) noted these data exhibit long-memory 


properties in time, and in Section 4, we showed the hexibility of the hrst class of models by 
htting a model that is long-memory in time that also meets the condition (j^. We also ht 
an adaptation of this model using a non-zero 9{u) to illustrate the space-time asymmetry 
present in these data. Half-spectral models of the form in ([^ therefore appear to be quite 
hexible and may be a good starting point for many model building purposes. 
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Space-time asymmetry was modeled as a phase shift using 0(cj) in this paper. Other 
methods exist that produce space-time asymmetry that may be of useful in half-spectral 
modeling. Geometric transformations of space in particular may be used. In such models, a 
spatial lag vector, s, may be substituted for a spatial lag shifted through time, s + Vt, where 
1/ is a vector indicating the magnitude and direction of the spatial shift. The interpretation 
of this asymmetry is straightforward. A model with this type of spatial shift is appropriate 
for physically moving processes. An added beneht to using this type of asymmetry is that an 
adaptation of Theorem 1 exists in this setting: these types of geometric transformations will 
not affect whether or not a model satishes (|^. Additional methods to produce space-time 
asymmetry may also be used in the half-spectral setting. Taking derivatives of a process 
in the manner of Jun & Stein (2007) can lead to space-time asymmetries as well as spatial 
anisotropy. Non-parametric deformation as seen in Sampson & Guttorp (1992) can also 
produce asymmetry. 

The half-spectral forms present in this paper serve as one step toward a more coherent 
melding of spatial and temporal methods in statistics. A primary avenue of future research 
may be to develop computationally efficient htting procedures for half-spectral models on 
data that do not have the nice structure of non-missing regular monitoring data. Adaptation 
of composite likelihood methods Lindsay (1988), Vecchia (1988) and Stein et ah (2004)] may 
serve as one way forward as these methods allow for considerations of only subsets of the 
full dataset. 


6 Appendix 

In this appendix, we prove the Theorems and Restrictions presented in Section 2. We 
give explicit forms for the half-spectrum of the model from Example 3 and of the marginal 
temporal spectrum, fc of G with parameter k hxed at 1. We also give details on the htting 
procedures used in Section 4. 

6.1 Proofs of Theorem 1 Statement (i) and the Restrictions 

Proofs of Theorem 1 Statement (i) and Restrictions 1 and 2 can be found here. Proof of 
Theorem 1 Statement (ii) has been put in Section 6.2 because its proof relies on two lemmas. 

Theorem 1, Statement (i) 1 Let g{X,u) be the full spectrum of a space-time covariance 
function where A is the spatial wavenumber and u is the temporal frequency. Let 6{-) be an 
odd function, and let (p be a unit vector in M'^. The following statement holds: 

(i) Let d(-) be locally bounded. The full spectrum g(X,u) satisfies ^ if and only if 
g{X — satisfies (^. 

Proof First, suppose g{X,uj) satishes ([^. If we can prove ||(A — 6*(a;)0, a;)|| —)■ oo as 
||(A,Ci;)|| — )• oo, we will have proved g{X — 6*(a;)0, cn) will satisfy ([^. When ||(A,a;)|| —>■ oo, 
there are two cases to examine: |a;| —>■ oo and the case where u is bounded as ||A|| diverges. 
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If |a;| —)• oo, ||(A —6*(a;)0, ci;)|| diverges to infinity. The remaining case, where uj is bounded 
as A grows, must be considered. Since 9 is locally bounded and oj is bounded, there exists 
some hxed A such that |6'(a;)| < A for all oj as ||(A,a;)|| —)■ oo. We have 

\\x - e{u)(j)\\ = y/xTx-2e{oj)XT(j) + e{u)^ 

> yi|Af-2||A||A 

Thus, ||A|| —)■ oo implies ||A — 9{u)(j)\\ —)■ oo. 

The reverse direction may be proved by recognizing g{X,u) as simply a phase shifted 
version of g{X — 9{u)(f),u) using the valid phase shift function —9{u). 


Restriction 1 Let the spectral representation of covariance function K have the form g{X,oj) 
p{oj)q{X,oj). The following two statements hold for spectral densities with this parameteriza¬ 
tion. 


(i) If g and q satisfy the condition in then p must he constant in oj. 

(a) If g satisfies the condition in then for every point ojq such that pipjo) is finite and 
positive, the marginal spectrum gl,^{X) = g{X,oJo) must meet the condition in (^. 


Proof For both (i) and (ii), we prove the contrapositive of each statement. First we prove 
(i). Assume p is not constant and q satishes ([^. Then there exists some oji and ui and R 
such that p{oJi +ui)/p{oJi) = C > 1 with |ui| < R. Let oj be hxed at oji, hence ||A|| — )■ cxd in 
the limit in ([^. Taking the supremum in (|^, we have 


sup 

||(u,l))||<K 


p{ui + u)q{X + v,Ui + u) ^ 

> 

p{ui+Ui)q{X,Ui + Ui) ^ 

p{ 0 Ji)q{X, 0 Ji) 


p{ui)q{X,Ui) 


= C 


q{X,0Ji +Ui) 

q{X,OJi) 


1 

c 


From here, we can bound the limit 


lim sup 


p{ui + u)q{X + v,Ui+u) ^ 

> C lim 

II A||^oo 

g(A,a;i + ui) 

1 

p{ui)q{X,Ui) 

q{X,Ui) 

C 


= C-1 


The last expression is strictly larger than 0; hence g cannot satisfy the condition in ([^. By 
contraposition (i) is proved. 

For case (ii), assume there exists uq such that p{ojo) is hnite and positive, and g(A,a;o) 
does not meet ([^ marginally in A. Fix oj = Uq, and let u = 0. Since 0 < p{ojo) < oo, 
pipjo)/ p{ojq) = 1. The condition in (|^ on is therefore equivalent to the same condition on 
q{X, cuo), which is not satished by assumption. Statement (ii) follows again by contraposition. 

Restriction 2 Let g{X,oj) = p{pj)q{X/5{pj)), where pioj) is positive and finite for all suf¬ 
ficiently large |ci;|, q is a non-negative, continuous, integrable function that is not identi¬ 
cally zero, and 5{oj) is even with a well-defined limit as |ci;| —)• oo. If g satisfies then 
limi^l^oo (5(a;) = oo. 
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Proof Like Restrictionj^ we prove Restrictionby contraposition. Assume lim|t^|^oo = 
E, where E < oo. Take ||(a;, A)|| —)■ oo along a path for which |a;| —)■ oo and A = 6{u)vo, 
where vq G and q{vo) > 0. Since q is integrable, there exists some ui 7 ^ 0 and some R 

such that q{vo + V\/E) 7 ^ q{vo) and HviH < R. The supremum in ([^ can be bounded from 
below: 


sup 

II («,■!)) II <i? 


p{u)q (no) 


> 


sup 

||(0,i-)||<R 


1 ("°+ jR) 

(li'Vo) 


> 


g (^0 + 4 ^) 


Since q is continuous and lim|^|_).oo = E, the limit of the supremum in (|^ is bounded 

away from zero: hm||(A,a;)||^oo sup||(„ \g{X + v,uj + u)/g{X,u) - 1| > 0. 


6.2 Proof of Theorem 1, Statement (ii) 

The proof of Theorem 1, Statement (ii) relies on the following two lemmas. 

Lemma 1 Let g{^), ^ G he a non-negative, integrable function. If g{f) satisfies 

then limii^ii^oo 5'(0 = 0- 

Proof We prove this statement using contradiction. Suppose limsup 3 ,_).o^ (7(.^o(2^)) 7^ 0 for 
a certain path indexed by a parameter, x, ^o{x) : M"*" —)■ such that ||'Co( 2 ^)|| —)■ cxd as 

X grows large. Therefore, there exists some e > 0 such that for each i G {1,2,...}, there 
exist some Xi > i where g{^o{xi)) > e. Since i|^o(3^i)|| —>■ C )0 as i —)■ cx), we can select a 
subsequence, written yi for i G (1,2,...} such that ||^o(l/j) — ^o(l/j)|| > 2 for i 7 ^ j. 

Now consider Isi^oiv ) L where indicates the ball of radius 1 

centered at point ^o{yi). Because the radius of these balls is less than or equal to half 
the distances between each center point, ^o{yi), these balls do not overlap. Thus the sum 
of their volume will lower bound the full integral fj^d+i g(0^C To complete this proof by 
contradiction, we show fB(^o(y ) 1 ) explodes by showing terms at sufficiently large 

values of i will have a positive number as a lower bound. 

We have g{^o{yi)) > £ > 0 for each i. And we have g{f) satisfies (|^. For a radius, R, set 
R = 1, and pick 6 = 1/2. Since g{f) satisfies (|^, it holds that there exists an / G M such 
that for all i > I, 

1 gj^oivi) + u) 3 

2 9 { M ) 2 

for all points such that ||[/|| < 1. Since g{f,o{yi)) > e, we find a lower bound for all points 
in the unit ball centered at ioiyf), inf^6S(j,(yp,i) ^((0 > e/2. Therefore, Isi^oiyXR - 

/[[d + l)V{{d + l)/2) for each i > I. Thus fj^d+i diverges, but this contradicts 

the integrability assumption. 
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Lemma 2 Let giOj ^ ^ be a strictly positive, integrable function. Let g{-), ^o(') 

and Uo{-) be a triplet, {rii-),^o{-),Uo{-)), where g : —)■ ,^o : ^ and 

f/o : M —)■ such that Uq{-)) has the following properties: 


(i) 11^0(3^)11 -^00 as X ^ 00. 


(a) ||?7(^o(3:))il is bounded. 


(Hi) 


For any C > 0 and for all x G M"*", there exists a Y E M. dependent only on C such 
that for all y > Y, 

HU^) + Uom\>c. 


IfgiO satisfies ©. then the function f{f) = g{g{(,)) cannot satisfy (^. 


Proof Loosely, the properties of the triplet, {g{-),f,o{-),Uo{-)), ensure that we can pick a 
point, y, large enough such that g{f,{x) + Uo{y)) is sufficiently far from g{(,o{x)) for all x. 
This, together with Lemmaprevents (|^ from being satished for f{(,). 

More formally, consider the supremum in condition ([^ for f{(,o{x)) and for any i? G M. 


sup 


+ u) 

> 

f{io{x) + Uo(y)) 

fMx)) 


fMx)) 


for any y such that ||f^o(2/)|| < R- Since R can be arbitrarily large, we know this condition 
can be satished. Substituting in g on the right hand side, we hnd 


sup 

||C/||<R 


fMn + u) 

> 

givi^oix) + Uo{y))) 

fiUx)) 


giviUx))) 


We know ||?7('Co(3^))|| is bounded and that g is strictly positive; hence, there exists some £ > 0 
such that g{g{fo{x))) > e for all x. 

By Lemma and property (hi) we also know y (and thus R) can be chosen large enough 
such that ( 7 ( 77 (.^ 0 ( 3 ^)+ f^o( 2 /))) < e/2 for all x. The limit of sup 


fmx)+u) 




- 1 


as X —)■ cxD 


must therefore be bounded below by 1/2 and thus cannot equal 0. Since ||^o(3^! 
X —)■ 00, we have found a path, .^ 0 ( 3 ^), that violates condition (|^ for f{^). 


—)■ cxD as 


Theorem 1, Statement (ii) 1 Let g{X,u) be the full spectrum of a space-time covariance 
function where A is the spatial wavenumber and oj is the temporal frequency. Let 9{-) be an 
odd function, and let (f be a unit vector in Let also g{X,u) be strictly positive, and let 
g{X,uj) satisfy If g{X — 0{oj)(f),oj) satisfies then 9{uj) must be locally bounded. 


Proof We prove this statement using contradiction. Assume 9{uj) is not locally bounded. 
The statement then follows almost directly from Lemma 2. To meet the conditions of Lemma 
2, we need to dehne a triplet, Uo{-)) that has the properties listed in Lemma 2. 

First we dehne ^ 0 ( 3 ^)- Since 9{oj) is not locally bounded, there exists a sequence, 
bJi,U2, ■ ■., and a bound. A, such that \ui\ < A for all i and ||6'(a;)|| — )■ 00 as i — )■ cx). Dehne 
i^o(x) =a;iif7 — l<x<7 and wq = 0 otherwise. We have |a;o(x)| < A for all x G M, and we 
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have that hm 3 ,_^oo il^( 1 ^ 0 ( 2 ^)) II 00 . Dehne ^o{x) = {9{uo{x))(l), Uo{x)). Thus ||^o(3^)|| 00 

as X —)■ cxD. 

Next, dehne 77 (A, a;) = {X—9{u)(j),u). Consider ? 7 (,^o(a^)) = {9{uo{x))(j)—9{uQ{x))(f),uo{x)) = 
(0,a;o(a^))- We know |a;o(x)| < A; therefore, ||? 7 ('Co(a^))|| is bounded. 

Finally we dehne Uo{y) = {y(f),0). We prove the triplet has property (hi) in Lemma 
2. Let C > 0. Consider + Uo{y)) = {Uo{y),Uo{x)) = {y((),Uo{x)). Therefore, 

llh(^o(a^) + C'o( 2 /))|| > ||#|| = y- Let Y = C. If 7 / > F, it follows that |h(Co(a;)+ Co(7/))|| > C 
for all X > 0. 

By assumption, g{^) = g(X,u) satishes ([^, and above, we established the triplet, 
(h(‘)) ^o(‘)) Lo(-))) has the properties in Lemma 2. Therefore, by Lemma 2, we know g{g{^)) = 
g{X — 9{u)(f)^u) cannot satisfy (|^. By contradiction, 9{oj) must be locally bounded. 


6.3 Half-Spectrum for Example 3 


Writing down the half-spectrum in Example 3 requires expressions for the quantile func¬ 
tion (inverse distribution function) of lAj rNJ i/V^ and the distribution function of the 
density /b oc (/3^ + . Write P{s,x) = 7 (s,x)/r(s) as the regularized gamma 

function, where 7 is the lower-incomplete gamma function ( Olver et al.||2010 ). The distribu¬ 
tion function F ^2 (x; u) is given by P{u, x/2). Hence F~ 2 ^ (x; u) = 2P“^(z/, x), and therefore. 


= 1 / 


X 2 ^' 

2 P“ 2 ^ (x; u). The inverse distribution function F^ 

X2u ^ 


^ ^ can be found directly as 


Fa (x; z/) = 


_ / -l/^4P-i(z/,l -2x); X < 1/2 
l/^4P-i(^, 2x- 1); X > 1/2 


To hnd Pg it is convenient to view fs as a special case of the hyper geometric function , 2 P 1 
(Olver et ah 2010). We writeoc 2 -^i(l, ^+1/2; 1;—o;^//?^) (Olver etal. 2010). For 
|a;//9| < 1 , indehnite integration can be carried out directly using the series representation of 
the hypergeometric function to hnd / /sdo; oc 2 Fi(l/ 2 ,fi: -f 1/2; 3/2; plus 

some constant. Hence by analytic continuation. 


Fb{uj-,/ 3 ,k) = 2 + 


1 F(K + l/2)n; „ /I 1 3 u 


F(ft:)yF /3 V2’2 ^^"’2’ 


can be dehned for the values of ui outside this rang e ([Olver et ah 2010). The constant in /b 
and Fb can be obtained in (Gradshteyn & Ryzhik 2007, 3.241.4). 

Dehne 5{u:] k) = \Fa {Fb{u:]I3^k)]v)\. With C(s;q;) = 0exp(— a^s^), we hnd the 
half spectral form of Example 3, 


f{u)C{s 5 {u)) = + a;2)-(-+V2) exp(-a2s252^^. 


6.4 Half-Spectrum of Kf^ 


To hnd the half-spectrum of P/q, we need only hnd the spectrum of the temporal covari¬ 
ance function G( 0 ,t)|K=i = 0 (/^|m| -f 1 )“^ written without the spatial nugget in ( 11 ) and 
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equivalently in (10). (Bateman 1954, p. 8) gives the calculation as a cosine transform, 

fciuj) = 


TTSin 


j-Hj 


sm 


M -.a M 


COS 


where Si and Ci are the Sine and Cosine integrals dehned in Olver et al. (2010). The tail of 
this spectrum decays asymptotically proportional to u:~‘^ (Olver et al. 2010). With fc, the 
half-spectrum of Kf^ is obtained by plugging fc into ([^. 

6.5 Fitting Procedures 

R is used for htting of all models using the general optimizer nlm with default optimization 
parameters. Numerical hessians are calculated in this implementation of nlm. In the previ¬ 
ous two sections of this Appendix, we showed how half-spectra can be calculated provided 
functions 2^1, Sine and Cosine integrals and the regularized gamma function, P, can be cal¬ 
culated. For P, we used the xiu quantile function included with R. We use the gsl package 
for the Sine and Cosine integral functions ( Hankin||2006 ), and we used the hypergeo package 
for 2 R 1 (Hankin & Lee 2006). The Block-Toeplitz solver for space-time htting was adapted 


from a MATLAB function by Pepper & Fricke (2011). 
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